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(57) ABSTRACT 

Electro-optical display apparatus includes a plurality of 
modular units each having a projector for receiving electri- 
cal signals, converting them to optical images, and project- 
ing the optical images via an optical projection system onto 
a screen. The modular units are arranged in a side-by-side 
array such as to produce a combined display on the screen. 
A calibration system detects distortions in the combined 
display caused by the projection system of each modular 
unit and modifies the electrical signals applied to the pro- 
jector of each modular unit to correct the combined display 
with respect to the detected distortions. 

25 Claims, 34 Drawing Sheets 
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Fig. 3 
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Fig. 5 
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Fig. 8a 
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Fig. 8b 
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Fig. 1 la 
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Fig. lib 
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Fig. 12b 
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Fig. 13 
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Fig. 14 
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Fig. 16 
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Fig. 16b 
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Fig. 17 
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Fig. 18 
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Fig. 19 
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Fig. 24 
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Fig. 25 
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Fig. 27 
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ELECTRO-OPTICAL DISPLAY APPARATUS 

FIELD AND BACKGROUND OF THE 
INVENTION 

The present invention relates to electro -optical display 
apparatus. The invention is particularly useful in large 
interactive displays of the type enabling one or more persons 
to interact with the display, by adding to, deleting from, or 
otherwise changing the displayed information; and the 
invention is therefore described below with respect to such 
an application. 

Various types of interactive displays are known, as 
described for example in U.S. Pat No. 5,495,269 and WO 
95/34881. Such known displays are generally constructed 
with the appropriately-sized screen according to the particu- 
lar application. Each display must therefore be specially 
designed for the respective screen size. Moroever, the depth 
of the display generally increases with the size of its screen. 

OBJECTS AND BRIEF SUMMARY OF THE 
INVENTION 

An object of the present invention is to provide displays 
which can be constructed so that they may be assembled in 
different sizes according to the respective application. 
Another object of the invention is to provide display appa- 
ratus which can be assembled to provide a relatively large 
size display but having relatively small depth. A further 
object of the invention is to provide an electro-optical device 
which can be used in an interactive manner by a user without 
the user obstructing the screen, A still further object of the 
invention is to provide a method of producing electro-optical 
displays of the interactive type. 

According to one aspect of the present invention, there is 
provided electro-optical display apparatus, comprising: a 
plurality of modular units each including a projector for 
receiving electrical signals, converting them to optical 
images, and projecting the optical images via an optical 
projection system onto the screen; the plurality of modular 
units being arranged in a side-by-side array such as to 
produce a combined display on a screen; the image sensor 
and imaging means being located on the same side of the 
screen as the projectors; the apparatus further comprising a 
calibration system including an image sensor for sensing an 
optical image on the screen, and imaging means, such as an 
imaging lens, for imaging the screen on the image sensor for 
detecting distortions in the combined display caused by the 
projection system of each modular unit and for modifying 
the electrical signals applied to the projector of each modu- 
lar unit to correct the combined display with respect to the 
detected distortions. 

According to further features in the described preferred 
embodiment, the screen is constituted of a plurality of 
modular unit screens, one provided on each of the modular 
units; and imaging means as set forth above for imaging the 
screen on the image sensor. 

According to still further features in the described pre- 
ferred embodiments, the screen is of a size and configuration 
to overlie all the modular units. In addition, the calibration 
system may also include a two-dimensional array of refer- 
ence points of known locations on the face of the screen. 

In one described preferred embodiment, the two- 
dimensional array of reference points is defined by the 
intersection points of a plurality of horizontal reference lines 
and a plurality of vertical reference lines on the screen. In a 
second described embodiment, the two-dimensional array of 
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reference points are the ends of optical fibers on the screen. 
The reference lines may also be the joint border lines of the 
individual module screens. In any case, the selected cali- 
bration technique may be used for on-line calibration or only 

s for off-line calibration. 

It will thus be seen that the foregoing features of the 
invention permit display apparatus to be constructed from 
one or more modular units of the same design, size and 
configuration, and to be assembled according to the particu- 

10 lar application. For example, apparatus can be assembled 
with two modular units arranged in a straight line, four 
modular units arranged in a 2x2 array, nine modular units 
arranged in a 3x3 array, etc., according to the size of the 
screen desired for the particular application. It will also be 

15 seen that the depth of the overall display will be the same 
irrespective of the size of the screen. 

Such an apparatus is capable of grabbing any image that 
appears on the screen, including images projected on the 
screen by a light projector or any hand- written script using 

20 dry -erase markers, electronic pens, etc. The apparatus can 
also grab the image of any object, e.g., documents, placed 
against the screen. Thus, the apparatus can be used not only 
for displaying documents, but also for storing or transmit- 
ting documents. Since the combined screen is not obstructed 

25 by the user, the user can conduct a natural flowing presen- 
tation. Since the system is modular, the configuration and the 
size of the combined screen can be fitted to any application; 
and since the system depth is relatively small, it may be used 
in office-like environments, or other space-limited 

30 environments, such as conference rooms, airport aisles 
(corridors), etc. 

The calibration system is preferably built into the appa- 
ratus as an integral part of the apparatus so that it can be 

35 conveniently used to recalibrate the system as frequently as 
may be desired, e.g., to compensate for the tendency of the 
opto-mechanical systems to drift with time and temperature. 
While the calibration system is particularly useful with 
respect to a large viewing area apparatus constructed of a 

40 plurality of modular units as described above, the calibration 
system could also be used in a single-unit setup. 

According to still further features in the described pre- 
ferred embodiments of both the multiple-unit and single-unit 
setup, the calibration system generates an image path cor- 

45 rection table for each unit for correcting discrepancies 
between the known locations of the two-dimensional array 
of reference points on the screen and the corresponding 
locations of the two-dimensional array of reference points as 
imaged on the screen. It also generates a projector-path 

50 correction table for each unit for correcting discrepancies 
between the known locations of the two-dimensional array 
of reference points on the screen and the corresponding 
locations of the two-dimensional array of reference points as 
projected on the screen. 

55 According to a yet further aspect of the present invention, 
there is provided a method of producing an electro-optical 
display comprising: providing a plurality of modular units 
each including a projector for receiving electrical signals, 
converting them to optical images, and projecting the optical 

60 images via an optical projection system on a screen; arrang- 
ing the plurality of modular units in a side-by-side array such 
as to combine their respective displays to produce a com- 
bined display; imaging the screen via imaging means, such 
as a lens, onto an image sensor for detecting distortions in 

65 the combined display; and modifying the electrical signals 
applied to the projector of each modular unit to correct the 
combined display with respect to the detected distortions. 
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Electro-optical display apparatus constructed in accor- FIG. 19 illustrates electro-optical display apparatus 

dance with the foregoing features may be used in a large including a plurality of projectors each equipped with a 

number of appUcations, including conference rooms, control Fresnel lens, and having a common diffusive screen to 

centers, and electronic bill-boards, as well as in front/rear produce uniformity from any viewing angle; 

large projection systems. 5 FIG. 20 is a schematic view of the Fresnel lens array in 

Further features and advantages of the invention will be the apparatus of FIG. 19; 

apparent from the description below. FIGS. 21a, 21b and 21c, diagramatically illustrate the 

front, side and top of a projector provided with mechanical 

BRIEF DESCRIPTION OF THE DRAWINGS means for making some of the mechanical corrections as an 

The invention is herein described, by way of example 10 alternative to digital corrections; 

only with reference to the accompanying drawings, FIGS. 22a, 226 and 22c are diagrams from the front, side 

wherein: t0 P» respectively, illustrating more particularly one 

* ,. • n mi * * i- ~f * manner of making, some of the mechanical corrections of 

FIG. 1 diagrammatically illustrates one example ot a 21 J21 • 

display apparatus in accordance with the present invention 15 FIGS - 21a 2lc > 

including four modular units, and a combined screen over- FIGS. 23*, 23b and 23c are diagrams ^histraung .different 

lying the screens of all the modular units; camera positioning arrangements to allow better distortion 

FIG. 2 diagrammatically illustrates one construction of a correction; 

modular .nil used in the display apparatus of FIG. 1; FIG. 24 is a flowchart lUustrating one example of the 

"V ^ ^ . n \ Y *u tv.i cummin 20 operations involved in using the camera positioning arrange- 

FIG. 3 diagrammatically illustrates the optical system m M V mQ ^ ^ cor * ctin color-convergence disp- 
one of the modular units m the apparatus of FIG. 2; ^ . q & ^ 

FIG. 4 more particularly illustrates the folded mirror piGS 2 5 and 26 are diagrams helpful in explaining the 

arrangement in the optical system in one of the modular flowchart 0 f FIG. 24; 

units; . . , 25 FIG. 27 is a flowchart illustrating one example of the 

FIG. 5 diagrammaticaUy illustrates another type of optical crations mvo lved in similarly correcting geometrical dis- 
system that may be used in each modular unit; 



tortions; 



FIGS. 6a-6e illustrate various types of distortions pro- and piG 2 8 is a diagram helpful in explaining the 

duced in the optical systems of the modular units which fl owc hart of FIG. 27; 
distortions are to be corrected by the calibration systems of 30 

the modular units; DESCRIPTION OF PREFERRED 

FIG. 7 illustrates a calibration grid on the combined EMBODIMENTS 

screen used for calibrating the modular units; Modular Construction 

views along tines 8a-8a and SbSh. respectively, of FIG. rf ^ ^ ^ arrangcd ^ a 2x2 

' . • r array in abutting relation such as to combine their respective 

FIG. 9 diagrammaticaUy illustrates one technique for ' to produce a combined display. The apparatus 

correcting non-uniformity in tight intensity in the modular includes a combined screen, generally designated 2, 

units; 40 of a size and configuration to overlie all the modular units. 

FIG. 10 illustrates an alternative structure of a combined ^ four mo d u lar units are of the same design, size and 

screen for calibrating the modular units for both distortions configuration so that they can be assembled to produce a 

caused by the optical systems and non-uniformity in light combined screen of the size and configuration desired for 

intensity in the modular units; m y particular application. 

FIGS. 11a and Mb diagrammatically illustrate one tech- 45 The construction of each modular unit Mj-M d is dia- 

nique for correcting spatial distortions in the imaging sys- grammatically illustrated in FIG. 2. Each modular unit 

terns of the modular units; includes a housing 3, and a rear projector 5 for receiving 

FIGS. 12a and \2b diagrammatically illustrate one tech- electrical signals, converting them to optical images, and 

nique for correcting spatial distortions in the imaging-path projecting the optical images onto screen 2 via an optical 

optical system, and in the projector optical systems, 50 projection system. The rear projector 5 is driven by a 

respectively, of the modular units; graphics computer 6 which receives the electrical signals via 

FIG 13 diagrammatically illustrates one technique for an input port 7 from a systems computer SC. Graphics 

eliminating overlaps and gaps between the displays in the computer 6 is preferably constructed as a separate unit and 

screens of the plurality of modular units; not built into the module 

r^T ^ . n u * -ii ♦ r of ih<> 55 Each modular unit further includes an image sensor 8 for 

FIG. 14 is a flowchart illustrating one examp of Jhe of ^ ^ 

overall calibration technique, constituted of the four ^ ^ Jj^ ^ g ^ ^ ^ ^ 

operations, A, B, C and D; to clcctrical signals electrical signals are 

FIG. 15 is a flowchart illustrating operation A in FIG. 14; slip * Ued to lhe grap hics computer 6 for driving the rear 

FIG. 16 is a flowchart illustrating operation B in FIG. 14; fi(J pro j cctor 5 to include also the images appearing on screen 2. 

FIGS. 16a, 16b and 16c are flowcharts illustrating certain R ear projector 5 is preferably an active color LCD (liguid 

sub -operations of operation B; crystal display) projector. However, it could be a Digital 

FIGS. 17 and 17a taken together, constitute a flowchart Micromirror Device Projector, or any other known type of 

illustrating operation C in FIG. 14; projector. Image sensor 8 is preferably a CCD (charge 

FIG 18 is a flowchart illustrating operation D in FIG. 14 65 coupled device) commonly used today in area cameras 

for correcting non-uniformity in light intensity between the However, it could be any other type of image sensor, such 

various modular units; as a tube camera, a scanner, etc. 
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The graphics computer 6 receives electrical signals from it will be seen that the amount of distortion vanes with the 

the image sensor 8, and from the systems computer SC via distance from the longitudinal axis LA and transverse axis 

the input port 7, and generates die signals (e.g., video TA. FIG. 6* fllustrates a barrel-type dis torted 

signab) driving the rear projector 5. Graphics computer 6 with respect to the undistorted image UI. FIG 6c Mvstr* tes 

further includes a built-in calibration system for calibrating S how a display combining the displays of the four modular 

the modular unit with respect to distortions (e.g., spatial, units M,-M 4 would appear without correction of the dis- 

intensity, and color) in the projected images in the respective tortious produced in each of the four modular units 

modular unit so as to reduce these distortions as appearing FIG. 6d illustrates an undistorted straight, horizontal hne 

in the combined screen 2 for all the modular units. The UL, to be projected on the combined screen by the four 

calibrating system also eliminates overlaps and gaps in the 10 modular units M,-M 4 ; whereas FIG. 6e illustrates at UL 

combined display on screen 2 of the four modular unit how that line would be distorted by the P*-«^">° effect, 

displays ^ DSI me rcsuItant sc™ 11 lma 8 c 8 ra y level " me djstor " 

Optical Systems t ' ons are n0 * corrected. 

FIGS 3 and 4 diagrammatically iUustrate the optical When viewing a screen containing but a single msplay 

projection system for projecting the image produced by the 15 from a single modular unit, the optical distortions produced 

rear projector 5 of the respective modular unit on screen 2, by the optical system can frequently be passed without 

and also the optical imaging system for imaging the screen notice; however, when producing a combined image 

2 on the image sensor 8 of the respective modular unit. wherein a plurality (m this case four) displays are sutched 

Thus as shown in FIGS. 3 and 4, the optical projection together in a "seamless" manner, geometric and color dis- 

system includes a lamp and reflector 10. This lamp may be 20 tortious produced in each modular unit are very much 

of any known type (e.g., tungsten halogen lamp, silver noticeable in the combined display. The major distortions 

halogen lamp, arc lamp, etc.) which illuminates, via a are: 

condensor lens 11 and IR/UV filter 11a, an LCD light l. Straightness distortions, resulting from the pin cushion 

modular panel 12 straddled by a pair of Fresnel lenses 13a, (PC) or barrel effect; 

13b. The image is magnified by a projection lens 14, and is 25 2. Overlaps and gaps along the contiguous sides of the 

projected by folding mirrors 15a, ISfc, 15c, onto the screen combined displays, resulting from the pin cushion (PC) 

2. The optical imaging system images the screen 2 onto the barrel distortions; 

image sensor 16 via mirrors 15o-15c and a lens system 17. 3 N on -uniformly m illumination (monochromatic and 

The light reflected from the screen 2 thus represents a color), resulting from differences in the light-intensity 

combined image, namely a superposition of the image 30 j eve j 0 f me individual modular units; 

produced by each rear projector 5, and any image written or 4 Q^^fe aberration; 

projected onto the front side of the screen and imaged onto 5 k , one (KS s effecl; 

the image sensor 8. The graphics computers 6 store a replica • mf . Kaxs in magnification (M) between adjacent 

of the rear-projected images and of the captured combined • ectors . 

image. From these two images, the system can determine the 35 P J • . 

user input, namely the image written or projected onto the 7. rotation (R «™ 

screen from the front side of the screen. 8. translation (X,Y) d^tort.on, and 

Alternatively another technique for grabbing the image 9. convergence (C) distortions inherent in individual 

written or projected on the front of the screen is by momen- projectors, 
tarilv turnine off the image produced by the rear projector, 40 The Calibration System 

and subsequently reading the image written or projected on It will thus be seen that in order to combine the displays 
the front side This technique simplifies the determination of a plurality of modular units, a calibration system is 
process of the user input since the grabbed image does not needed to detect these distortions and to correct the corn- 
include the rear projected image. bined image with respect to these dustortions. The ca^ration 

Both the optical projector system and the optical imaging 45 system to be described below corrects for most of the above 

system inherently produce distortions, which are detected distortions. While the calibration system can be provided as 

and corrected by the graphics computer 6, as will be a separate system, to be used during the first setup of the 

described more particularly below, so as to produce a more display system or whenever else it may be desired to 

satisfactory display on screen 2 combining the images calibrate the system, the calibration system included in the 
generated by each of the modular units M,-M 4 . so apparatus to be described below is built into the system as 

FIG 5 diagrammatically illustrates another optical an integral part. It therefore has the important advantages 

arrangement that may be used for each of the modular units that it can be more frequently used in a convenient manner 

M -M As in FIG 3 instead of using a common optical to correct for the tendency of optical-mechanical systems to 

system' for combining the image projected by the rear- drift with time and temperature. 

projector 5 onto the screen 2 and the image of the screen 2 55 The built-in calibration system illustrated in FIG _ 7 

received by tbe image sensor 8, the modular unit is provided includes a plurality of horizontal reference lines 20 and a 

with a separate optical projection system diagrammatically plurality of vertical reference lines 21 formed on the face of 

illustrated »l 18, and a separate optical imaging system the combined screen 2 such that the intersection points of the 

diaerammatically illustrated at 19. However, in FIG. 5 the two groups of reference lines define a two-climensional array 

projection system and the imaging system include a folded 60 or grid of reference points 22 of prcasely-known bcations 

minor arrangement as in FIG. 4. on the face of the combined screen 2 As shown in FIDS. 8a 

Distortions Produced by the Opto-Mechanical Systems and Sb, the reference lines 20 and 21 are produced by 

It is an inherent characteristic of optical systems that they forming V-grooves 23 on the face of the combined screen 2 

produce distortions when magnifying images. FIG. 6a illus- and filling tbe grooves with a himmescent material 24 which 

trates a rectangular undistorted or ideal image UI having a 65 is excited by a horizontal light source 25 extending along 

longitudinal axis LA and a transverse axis TA. FIG. 6a also one edge (the upper edge) of the combined screen 2 and a 

illustrates a pin-cushion type distorted image PDI, wherein vertical light source 26 extending along one side (the left 
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side) of the combined screen. Each of the two light sources the optical systems of the several modular units, and also 

25 26 is enclosed by a reflector 25a, 26a, formed with an non-uniformity in the light-intensity levels of the modular 

opening 25b, 266, facing the combined screen 2 so as to units, will now be described, for purposes of example only, 

direct the light towards the luminescent material 24 carried with reference to the diagrams of FIGS, lla-13 and the 

by the combined screen. Preferably, the luminiscent material 5 flowcharts of FIGS. 14-18. 

24 is an ultraviolet (UV) fluorescent material, and the light p[Q 14 is a general flowchart illustrating the overall 

sources 25, 26 are UV light sources which cause the material calibration technique. The calibration is constituted of four 

24 to fluoresce. main operations, designated Operations A, B, C and D, 

As one example, the combined screen 2 may be con- respectively, as appearing in blocks 51-54. 
structcd of a rigid light transmissive (translucent) panel 27 1Q Operation A, block 51, involves the calibration of the 

formed on its inner face 27a with the V-grooves 23 filled imaging pa th in each module. In this operation, the distor- 

with the luminescent material 24 defining the grid of refer- ^ ^ imaging system, from the screen 2 to the 

ence lines 20, 21, the opposite face 276 of the transparent ^ g m ^ respective mo dule, are detected and 

panel serving as a write-on surface by a user .The ^combined corrected b me ^ aphics computer 6 of the respective 

screen 2 further includes a flexible P^sheet ^ eg. of ^ Ucularl fltaslnrtcd in the 

"Mylar" sheet material having a rough surface, covering the « * - pf r « , 

grooved face 27* of the transparent panel 27 and the * G " 52 mvolves me of the 

by the intersections of the horizontal and vertical lines 20, m the optical projection system, from die car P«P«" 5 to 
21 is used for detecting and correcting distorUons caused by 20 me screen 2, are detected and corrected also by the graphics 

the optical systems in each modular unit, as described more computer 6 of the respective module. This operation is more 

particularly below. particularly illustrated in the flowcharts of FIGS. 16, 16a, 

FIG. 9 diagrammatically illustrates a technique that may 166 and 16c. 

be used for calibrating for non-uniformity in the light Operation C, block 53, involves the calibration of the 
intensity of the modular units Mj-M 4 . For this purpose, the 25 array 0 f projectors in the plurality of modular units Mj-N^ 

combined screen 2 is provided with a plurality of optical l0 fine-tune the combined image projected on the combined 

fibers 30 having one of their ends 31 located on the inner scree n 2, including eliminating overlaps and gaps between 

face of the combined screen 2 to sense the light intensity at me displays in each of the modules caused by distortions in 

the respective location. The opposite end of each optical me opt icai systems. This operation as well as the other 
fiber 30 is connected to a light detector 32 producing an 3Q prev i 0 usly-described distortion-correction operations, is 

output corresponding to the light intensity at the respective performed by the graphics computer 6 in the respective 

location 31. The outputs of light detectors 32 are connected m odules Mj-M*, and also by the systems computer SC 

to a control circuit 33 which controls the intensity of the wnich controls all the modules, and is illustrated in the 

light sources in the rear projectors (5, FIG. 2), constituting fl owc harts of FIGS. 17 and 17a. 

the projection system designated by block 34 in FIG, 9, so 35 Operation D, block 54, involves the calibration for non- 

as to reduce non-uniformity in the light intensities of the uniformity in light intensity levels among all the modules. In 

light sources in the modular units. The imaging system 35, ^ operat i onj me light intensity levels of the images pro- 

including the light sensors 8 of the modular units, is separate j ccted Qn ^ com b me d screen from all the modular units are 

frnm tftP projection system ftl v™ n » r rhp ot detected and controlled to reduce non-uniformity. This 
V\ Q 5. and also controls the contr ol circuit 33. ^ 40 operation is also performed by the grannies co mputer 6 of 

FIG. 10 illustrates another technique that may be used for jT ft modular units, as well as bv the svstems compute r_§£L> 

detecting and correcting not only distortions in the optical ^ntrnllirn «11 ih- "™ fa1 ar units and is illusttateJ ini the 

systems of the respective modular units Mj-M^ but also "flowchart^ FIH 1ft- — 

non-uniformity in the light intensities of the projector OperationA (FIG. 15) 

devices in these modular units. As shown in FIG. 10, 45 ^ snown m the flowchart of FIG. 15 illustrating Opera- 

combiDed screen 2 includes a plurality of optical fibers 41 don A ( D j 0C k 51, FIG. 14), the first step is to energize the two 

having one of their ends 42 embedded in the face of the mbcs 2 s t 26 (FIG. 7) of the first modular unit M x in order 

combined screen at precisely-known locations to define the tQ p ro d uce in that modular unit the visual reference lines 20, 

two-dimensional array of reference points of known loca- 2 l (FIG. 7) defining, at their intersections 22, the two- 

tions on the face of the combined screen. The opposite end 5Q dimensional array of reference points of known locations on 

of each optical fiber 41 is connected to a light emitter 43 mc face nf me com bi n ed screen 2. This step is indicated by 

(e.g., a LED), and also to a light sensor 44 (e.g., a block 61 in pj G 15 j^e ^ produced by these 

photodetector) via a beam splitter cube 45. The light emitter reference lines is shown by horizontal lines HLo-HL 6 and 

43 and light sensor 44 of each optical fiber 41 are connected vert ical lines VLo-VL 6 , respectively, in FIG. 11a. 

in parallel so as to be selectively enabled. 55 image sensor 8 in the respective module grabs the 

Thus, when the optical fibers 41 are to be used for image produced on the combined screen 2 for the respective 

producing the two-dimensional array of reference points 42 m odule (block 62). However, because of the distortions 

(corresponding to reference points 22 in FIG. 7), the light causc d by the optical system in the imaging path from the 

emitters 43 of the optical fibers 41 are energized; and when screen 2 to the image sensor 8, the actual image "seen" by 

the optical fibers 41 are to be used for detecting and fi(J ^ xngQt ^ nQi mc i dca i gr id illustrated in FIG. 11a, 

correcting non-uniformity in light intensity of the rear but ^^j. me distorted grid illustrated in FIG. Mb. That is, 

projectors in the modular units, the light sensors 44 are wncrcas ^ trjc horizontal and vertical lines in the ideal grid 

enabled. of FIG. 11a are straight and perpendicular to each other, in 

Operation the distorted grid illustrated in FIG. lib all the horizontal 

Overall OperaUon 65 lines HL^HL* and vertical lines VL'o-VL** (except lines 

One manner in which the above-described calibration HL, and Vl^ along the longitudinal axis and the transverse 

systems are used for detecting and correcting distortions in axis TA) are distorted because of the inherent distorUons of 
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the imaging-path optics. These distortions increase with the 
distance of the respective line from the longitudinal axis LA 
and transverse axis TA. 

The intersection points of the horizontal and vertical 
reference lines, defining the two-dimensional array of ref- 5 
erence points, are determined in the distorted grid of FIG. 
116 (block 63), and are correlated with the known locations 
of the reference points in the ideal grid of FIG. 11a (block 
64). The graphics processor 6 for the respective module then 
calculates a two-dimensional, best-fit cubic function for 10 
transforming the intersection points of the distorted grid to 
those of the ideal grid. Such calculations are well known; see 
for example "Image Reconstruction by Parametric Cubic 
Convolution" by Stephen K. Park and Robert A. 
Schowengerdt, published in "Computer Vision, Graphics 15 
and [mage Processing" 23, 258-272. This procedure is 
performed for each horizontal pair of lines (box 65), and for 
each pair of vertical lines (box 66). 

A two-dimensional Image-Path Correction Tabic is then 
produced and stored in the graphics computer 6 for the 20 
respective module for each of the reference points in two- 
dimensional array reference points (block 67). The forego- 
ing steps are then repeated N 2 -N 4 for all the remaining 
modules M 2 -M 4 (block 68). 

The result of blocks 65 and 66 is a set of distortion 25 
functions for each horizontal line 20 and each vertical line 
21 of the stored ideal grid (FIG. 7), i.e., seven (in the 
described example of FIG. llfl) horizontal functions and 
seven vertical functions. The Image -Path Correction Table 
calculated in block 67 is a correction table which enables the 30 
system hardware to convert the grabbed distorted images of 
the imaging path into distortion-free images. 

The above-described technique for performing Operation 
A has a number of advantages, including the following: The 
calculation of a best-fit function filters out (smoothes) any 35 
local noise generated by the imaging path, or local error in 
the reference grid. In addition, the calculation of a cubic 
function for each reference line enables determination, by 
interpolation, of all the other points that are not on the 
reference grid. In addition, the representation of the distor- 40 
tation data by a cubic function (as distinguished from a 
table) enables handling and storing the data in a more 
compact manner. 

Operation B (FIGS. 16, 16a, 166, 16c) 

FIG. 16 illustrates the steps of Operation B (block 52, 45 
FIG. 14) involving the calibration of the projector path in 
each module. This operation detects the distortions produced 
in the projector path optics, i.e., from the rear projector 5 of 
the respective module to the combined screen 2, and pro- 
duces a Projector Path Correction Table for correcting these 50 
distortions. 

Thus, as shown in FIG, 16, the stored ideal grid (FIG. llfl) 
is projected onto the combined screen 2 (block 71), which 
image is distorted by the projector path optics. The projected 
image is partially reflected from the screen onto the image 55 
sensor (8, FIG. 2) of the respective module (block 72), 
which grabbed image is distorted by the distortions in the 
imaging-path optics. This distorted image of the grid is 
illustrated in FIG. lib. 

The graphics processor (6, FIG. 2) of the respective 60 
module corrects the intersection points (reference points) in 
the distorted grid (block 73) according to the flowchart 
illustrated in FIG. 16a. Thus, as shown in FIG. 16a, for 
every pixel in the grabbed image, a calculation is mack from 
the Image-Path Correction Table (produced in Operation A 65 
according to the flowchart of FIG. 15) of the four surround- 
ing grid reference points; and then by using bi-linear inter- 



polation (block 736), each such pixel is relocated to the 
correct location. 

The steps of blocks 73a, 736 in the flowchart of FIG. 16a 
are more particularly illustrated in the diagram of FIG. 12a. 
Thus, the location of the distorted pixel in the distorted grid 
is indicated at DP, and the locations of the four surrounding 
pixels in the distorted grid are indicated at DPx-DP^ The 
locations of the corresponding four pixels on the ideal 
(corrected) grid are indicated at CP,-CP 4 ; and the corrected 
location of the corresponding pixel is indicated at CP. 

Following the steps indicated by block 73 in FIG. 16 (and 
blocks 73a, 72b in FIG. 16a), the graphics computer of the 
respective module has now an image of the projected screen 
that is free of the distortions of the imaging-path optics, and 
includes only the distortions of the projection-path optics. 

A Projection -Path Correction Table is then calculated for 
the projection path optics (block 74). The Projector- Path 
Correction Table provides, for every ideal-grid reference 
location, the correct locations of the projected reference 
points in the distorted grid. The manner in which the 
Projector-Path Correction Table (block 74) is calculated is 
more particularly illustrated by steps 74a-74/in FIG. 16b. 

As shown in FIG. 16, a check is made as to whether the 
distortion is smaller than the threshold (block 75). If not (i.e., 
the distortion is larger than the threshold) the correct loca- 
tion of the reference point is determined and stored accord- 
ing to the flowchart illustrated in FIG. 16c and the diagram 
of FIG. Ub, 

Thus, for every pixel in the projected image (PP, FIG. 
126) a determination is made from the Projector-Path Cor- 
rection Table of the four surrounding grid reference points 
PP 1 -PP 4 (blocks 76a, FIG. 16c). By using bi-linear inter- 
polation (block 766), the corresponding points CPj-CP* on 
the ideal correct grid are determined for relocating the pixel 
to the correct location CP (block 76b). 

After the above-described distortion calibration has been 
completed for the projector path of the respective module 
(block 76), the procedure is repeated with respect to the 
other three modules M 2 -M 4 (block 77). Upon the comple- 
tion of Operation B for all the modulator units, the projector 
of each modular unit is now corrected for distortions in their 
optical systems. 
Operation C (FIGS. 17, 17a) 

Operation C (block 53, FIG. 14) is now performed to 
calibrate the array of projectors to form one combined 
projector image. In this operation, the projector displays of 
the four modular units are treated as four tiles with parallel 
coordinate systems on the plane of the combined screen 2, 
and are electronically moved vertically and horizontally 
until they cover the face of the combined screen 2 with no 
overlaps and no gaps. This operation is more particularly 
described in FIGS. 17 and 17a, and is illustrated in the 
diagram of FIG. 13. 

Thus, as shown in FIG. 17, the horizontal lines are 
projected from the first module (block 81), and the image of 
the horizontal lines from the imaging path of the first module 
is grabbed (block 82). The horizontal lines from the second 
module are then projected (block 83), and the image of the 
horizontal lines from the imaging path of the first module are 
grabbed (block 84). The location of the stored image in the 
projector of the second module is then moved laterally by a 
horizontal offset, and vertically by vertical offset, until the 
lines are aligned (block 85). The foregoing steps are 
repeated for the third and fourth modules by calculating the 
horizontal offset and vertical offset for these modules (block 
86) 

The same procedure is then repeated for the vertical lines 
(block 87), as more particularly set forth in the flowchart of 
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FIG. 17a, where the corresponding steps are indicated by calibrate for differences between the modules, the system 

blocks Sla-S7f. uses sensing detectors in each module which are capable of 

Operation D (FIG. 18) reading the average brightness level of light projected on the 

Upon the completion of Operation C (block 53, FIG. 14), screen. As described above, the light sensors arc comprised 

Operation D is performed (block 54, FIG. 14) for detecting 5 of optic fibers whose tips are attached to the face of the 

and correcting non-uniformity in the light intensity among screen, shown at 31 in FIG. 9, and at 42 in FIG. 10. Each 

all the modules. This operation is more particularly illus- fiber tip collects a fraction of the light projected on the 

tratcd in the flowchart of FIG. 18, and uses the light intensity screen and transfers this light to the light detector. The fiber 

detectors (optical fibers 30 of FIG. 9, or 41 of FIG. 10) for by itself interferes minimally with the projected image due 

this purpose. 10 to the fact that the fiber is extremely thin (around 100 /an) 

In calibrating for non-uniformity in illumination on the and the fact that only the fiber tip is close to the screen, 

combined screen 2, the following assumptions are made: whereas most of the fiber length is away from the screen and 

1. Illumination differences between the modules are glo- out of focus. The light sensors readout (of the light level 
balin nature, meaning that the non-uniformity profiles of the projected on the screen) will be inputs to the graphics 
modules are similar in shape, but non-similar in amplitude. 35 processor. The graphics processor will use this input to 
The difference between the ampliudes is a result of differ- calculate the difference between the modules and to control 
ences in the brightness of the lamps in each module and the attenuation of the light modulators, as described in step 
differences in the optical attenuation of each module. (1) of the calibration. 

2. The variation of illumination within each module are Following is one example of a design: projector lens, 
gradual at very low spatial frequency. 20 B-Nikkor, M35, f75.6; imaging lens, Panasonic WV-Lf6; 

3. The non-unformity of the illumination of the screen of LCD panel, Sharp model LQ64P312; light source, 400 watt 
each module may behave according to a known physical Tungsten-Halogen lamp. Osram HLX 64665; and graphics 
behavior, e.g., according to the following: computer, Texas Instruments TMS320C80. 

Screen Structure 

/-fc*cos(0)"4 Eq. i ^ piQS. 19 and 20 illustrate four projectors 100 (only two 

of which are seen in the top view of FIG. 19), each having 
wherein: a ^rive 102 providing six degrees of movement Each 

I«illumination brightness on the screen as seen by the projector includes a Fresnel lens 104 which collimates the 
viewer; light from the respective projector. All the Fresnel lenses are 

0=angle of point on screen relative to optical axis; 30 covered by common screen 106, e.g. constructed with a 
k»arbitrary coefficient lenticular or a diffusing surface, for scattering the light and 

For a module with focal length»100 cm, projection area- thereby providing more uniformity from any viewing angle. 
60 cmx80 cm, the falloff in the corner of the screen is A blocking element 108 is mounted by a member 110 to 
-31.4%. This falloff is very gradual and has a circular underlie the junctures between adjacent Fresnel lenses 104 
symmetry, relative to the optical axis of the module. 35 in order to reduce overlapping of the light from the projec- 

As shown in FIG. 18, the calibration of illumination tors and thereby to produce a seamless combined display, 
non-uniformity involves two major steps: Correcting Distortions Mechanically 

1. Calibration of known non-uniformity (e.g., as described The following distortions can be corrected mechanically 
above) within each module's field. or optically: 

This non-uniformity will be corrected, for each module, 40 \ t straightness distortions and overlap gaps both resulting 
by adjusting the gray level of each module stored image. The from the Pin Cushion (PC) and barrel distortions; 

adjustment of the gray level uses the light-modulator's 2 . keystone effect; 

capacity to modulate its transparency in an almost continu- 3 mJ ^ flca(ijm ^ fferences betwee n adjacent projectors; 

ous way. As an example, assume that a uniformly white neld 0 

is to be projected on the entire module's screen, having the 45 rotation distortion; and 

parameters mentioned in assumption (3), and that the light 5. translation distortion. 

modulator has 256 gray levels. The graphics processor will FIGS. 2U-2U also illustrate how the drives 102 of the 

generate an image which has a value of 255*(1-0.314), or projectors 100 can be controlled for correcting translation 
175 gray levels in the middle pixels of the screen, and 255 distortions (x, y), rotation distortions (R), magnification 
in the corner pixels. The gray level of the other pixels will 50 distortions (M), and also distortions due to the Keystone 
be calculated in accordance with Eq. 1. These values will effect (KS,, KS y ). Pin cushion (PC) and barrel distortions 
cause the light modulator to attentuate the transmitted light can be corrected by using curved mirrors, e.g. for one or 
in such proportion that the illumination on the module's more of the folding mirrors 15fl-15c in FIG. 4. Color 
screen will be flat (uniform) over the entire face of the convergence distortions, however, may be corrected digi- 
screen 55 tally by moving the respective pixel elements the required 

The foregoing operation is implemented by blocks 90 and sub -pixel distances as described earlier. 
91 in FIG. 18, and will be used for all modules. The result FIGS. 22a-22c are front, side and top views, respectively 
of this operation is that within each module, the screen's illustrating one manner of providing each projector drive 
brightness is uniform, but the average brightness level of the 102 with six degrees of movement Thus, the arrangement 
modules will vary from module to module. The difference 60 illustrated in FIGS. 22a-22c includes seven plates 111-117 
between the modules is calibrated in the next step imple- supported one on top of the other, the upper most plate 117 
mented by blocks 92 and 93. supporting the projector 100. Plate 112 is movable vertically 

2. Calibration of differences between the modules: with respect to plate 111 to correct for y-translation distor- 
As mentioned before, the assumption is that after step (1) lions; plate 113 is slidable horizontally on plate 112 to 

(blocks 90, 91) of the calibration, the field of each module 65 correct for magnification differences (M); plate 114 is mov- 
is uniform, but the average (DC) level of the module is able on plate 113 along the x-axis to correct for X-translation 
different, from module to module. Therefore, in order to distortions (X); plate 115 is pivotally mounted to plate 114 
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about axis 115a (FIG 22c) to correct for the Keystone FIG. 236 or 23c arrangement. This is done by simply 

££t£? KSy! State' 116 is pivo«ally mounted about a averaging the pixels which were projected by each projector 

central axis 116a to plate 115 to correct for the Keystone separately. 

abortions KSy and plate 117 is pivotal about pivot 117a to This basic step is repeated many times for vanous R/G/B 

U6 to «rV"rfor rotational distortions (R). s configurations subject to the umitation, fcat only one color 

FIGS 23a-23c illustrate different camera positionings component takes a non-zero value There is no need to 

wiS respelt to the screens (preferably normal to the screen measure complex R/G/B «flgm»» "J** 

in a symmetric way) for the four projectors. Thus, FIG. 23a linear combinations of the basic R/O/O, O/G/O and O/O/B 

illustrates four cameras 121-124 each located to image the patterns. 

^ of IheTespXe projector screen 131-134; FIG. 236 10 The next step is to convert the R/GA l ° 

^fJ»te S tL four cameras 141-144 located to image the the CIE-XYZ chromaticity coordinates system. This is a 

%%£te£^Ssl«* HO. 23c ilhitra.es problem which is solved in the ^rature see ^example: 

five cameras 161-165 located to image the corners of the "Connoly C, Leung T. W W. and Nobbs J., lie Use or 

four ^ 171-174. The edge positioning arrangement Video Cameras for remote Colour MeasuremerU .submitted 

U^trated h FIG. 23b, and the corner positioning arrange- is to Journal of Society of Dyers and Colons*, February 

ment illustrated in FIG. 23c, allow better distortion 1995". 

cordon See the same camera views more than one The problem to be solved now is well known in the 

STma« and can be centred around a more problem- literature as "Gamut Mapping" (or alternate y as Color 

moauie image <tiiu g Transformat i on »). The objective is to present a col- 

rSrecScolor and Intensity Distortions 20 ored image using a restricted set (i.e. reduced space) of 

The Section of color distortions is done by modifying colors so that it will be seen by an average human viewer as 
the UwX™Tot each projected pixel. Intensity close as possible to the original una ge. 
Uniformity correction is done by the same mechanism and is Roy Hafl, "'^^X^'^StoS^S 
oracticallv a side effect of the color correction mechanism. Imagery", (Spring Verlag 1989) and Device Directed Ken 
For «mpk T C and B (i.e. the Green and Blue is dering" by A. S. Glassner et al ACM, Transaction on 
comp^nenS respectively) are not changed and R (the Red Graphics VOL 14 No. 1 January^ ip.g-SW6 
component) is multiple by Oii, then the pixel becomes less The color correction is done on each pixel by the hard 
"reS" However, If G, B and R are all multiplied by 0.5 ware. The correction comprises three operations: 
,h«te hueTu^angek but the intensity decreases. (1) Linearization: Using a table lookup, each of the 

There are two main physical reasons which cause color 30 R/G/B values is replaced by X-JC-Xo where X stands fo 
and "eiTty d^tortfo^The first is the fact that each R/G/B respectively and y <^> 
nmiector uses its own lamp to project the image, and each characterizing the electro-optical properties of the projector. 
fZ t S ^^iSpX 'signature which is deter- Tnis step is called "linearization" since the ne* -values are 
mTned 1 by thTexact manufacturing conditions and which is linearly proportional to the physically measured illumina- 
also changed over time (generally, the emitted light gets 35 lion produced by the projector. 

"re^Td the intensity gets lower as time evolves; this is (2) Transformation: Asunple ^ 
U^e for metal-halide lamps which are commonly used in a 3x3 matrix) which result in a new R/G/B triplet. 
p7o ec^us each projector produces slightly different (3) De-Linearization: ^J^«*™^lIS 
colors relative to its neighbours. The second reason (which step u> performed to prepare the R/G/B values properly to be 
nSy apSes to intensity corrections) is a non-uniform 40 projected by me projector (which applies a built-m gamma 
liaht inien<iitv (eenerallv the center of the image is more on its digital input). . 
Sl£^.n^£r£ts) emitted from tte projector The flowchart of FIG. 24 illustrates the foregoing steps 
uiumiudicu ma v / involved in the correction for color convergence distortions 

^re arf ^Ztact Rations that are done in the ma single projector, and the diagram of FIGS. 25 and 26 
system reg^ S nd'hence, intensity) correction: 45 illustrate this operation Completion of the four steps se 
^rEsS^of the color distortions (which is done as forth in the flowchart of FIG. 24 results in a correction table 
vi^SrtioniihiM^ ^ which each color pixel has been moved the required 

Par (2i ^Co^rrSoYof Jl' the pixels in each projected sub-pixe, value to correct for color convergence distortions, 
frie (which * done by the hardware which controls the ^ ^X^^S^^^^^ 
Pro Tne Sor distortions estimation is done as part of the ment to operations B and C which are presented in FIG. 14 
system calibration phase. It is based on using the video as part of the mam embodiment 

cameras (CCDs) as color measuring tools. Each camera is This alternative embodiment is based on the existence, 
Ted toiaS me borfer of a plurality of adjacent regions, and the possibility to detect^ fixed >™ £ 

eT as shown in FIG 236 or FIG. 23c. Thus the camera is 55 located exactly between tie adjacent Fresnel lenses. By 
us^d first o7aU to measure the relative color differences adjusting me shape of each projected miage to fiU precisely 
rTtw«n neXring projectors. This is done by repeating into the rectangle formed by the reference lines, the need in 

tt&S^*^"*" ^^^^^^ 

K^^TSt and intensity (i.e. the same « *f«to*^^W«*"*°»**** 

R/G/B digital values) by the two (or four) adjacent projec- J^ 0 / J* digitally by implement- 

to ?21 Canture a snapshot of the area covered by the projec- tag a well known resampling algorithm (as in the above 

to TtaS mS be repeated several times to improve the mentioned operation B). Tne resamphng is done on each 

S^bv aveS me snapshots. « projected image separately in exactly the same manner. The 

^) MdyzeTe calredtoage to estimate R/G/B, of the resamphng is done using a ^n-varymg non-homogenous 

two on Tore) priors, asseen by the camera e.g., in the non-linear pixel distribution. Tnus means that the location of 



10/17/2003, EAST Version: 1.04.0000 



US 6,219 ; 

15 

each resampled pixel is pre-de terra in ed once using a com- 
plex formula which takes into account the pixel desired 
location on the screen, and various distortion parameters 
which characterize the projector. For example, if it is found 
that the projector is misaligned by 0.5 pixel to the right 5 
(denoted as X=0.5) when projecting the original image, then 
each projected pixel int he reshaped image is resampled 0.5 
pixel to the left of the corresponding original pixel. The 
actual formula in this embodiment similarly takes into 
account vertical shift (denoted as Y), zoom factor (M), axial 
rotation (R), horizontal and vertical keystone (KSx,KSy) 1 
and the Pin Cushion effect (PC) or barrel effect. 

These distortion parameters are found once during the 
system calibration step using the algorithm illustrated in 
FIG. 27, as follows: 

Each module is calibrated separately in this scheme. The 15 
algorithm starts by setting all the distortion parameters of the 
current module (which are initially known) to zero (step 201, 
FIG. 27). This results in projecting images just as they are, 
with no reshaping. The algorithm uses only one type of 
image, which is a rectangle internal to the reference lines (as 20 
can be seen in FIG. 28). The distance between the points 
forming the internal rectangle to the external rectangle 
(formed by the reference lines) is constant. The algorithm is 
iterative, trying to improve the values of the distortion 
parameters in each iteration. 25 

In step 202 (FIG. 27), an image forming an internal 
rectangle, corrected using the current values of the distortion 
parameters, is projected. In step 203 the image is captured 
and the distances shown in FIG. 28 are measured. In step 
204 the corrections to the distortion parameters (i.e., dX, dY, 30 
dM, etc.) are computed using the distances measured in step 
203. The following is the heart of this algorithm: if the 
distortion parameters are correct, the internal rectangle is 
projected properly; hence all the distances measured in step 
203 are equal, and the quantities calculated in step 204 are 35 
all zero. 

In step 205 the distortion parameters are updated using the 
corrections found in step 204 using expressions such as: 
X«X+dX, Y=Y+dY, etc. The exact expressions are specific 
to the iterative algorithm used to control the convergence of 40 
the distortion parameters. One possible algorithm is the 
"Direction Set" (or "Conjugates Gradient") technique (such 
as described in "Numerical Recipies in C by W.H. Press, B. 
P. Flannery, S. A. Teukalsky and W. T. Betterling, Cam- 
bridge University Press, ISBN-0-521-35465-X, Chapter 10 45 
(Minimization or Maximization of Functions), First Edition, 
1988). 

In step 206 the relative change in the distortion param- 
eters is evaluated. If this value is close enough to zero, then 
the algorithm stops. Otherwise, a new iteration is started by 50 
going back to step 202. However, this time the internal 
rectangle is resampled in a different way than in the previous 
iteration. Hence it is projected in a form which is closer to 
a perfect rectangle as it should be. 

While the invention has been described with respect to 55 
several preferred embodiments, it will be appreciated that 
these are set forth merely for purposes of example, and that 
many changes may be made. For example, each modular 
unit could include its own screen, with a separate combined 
screen applied to overlie all the screens of the modular units. 60 
Also, the calibration operations can be performed by an 
external computer. Many other variations, modifications and 
applications of the invention will be apparent. 

What is claimed is: 

1. Electro-optical display apparatus, comprising: 65 
a plurality of modular units each including a projector for 
receiving electrical signals, converting them to optical 
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images, and projecting said optical images via an 
optical projection system onto a screen; 
said plurality of modular units being arranged in a side- 
by-side array such as to produce a combined display on 
said screen; 

said apparatus further comprising a calibration system 
including an image sensor for sensing an optical image 
on said screen, and imaging means spaced from the 
screen and producing an image of the screen on said 
image sensor, for detecting geometrical distortions in 
said combined display caused by said projection system 
of each modular unit and for modifying the electrical 
signals applied to said projector of each modular unit to 
correct said combined display with respect to said 
detected geometrical distortions; 

said image sensor and imaging means being located on 
the same side of the screen as the projectors for the 
plurality of modular units; 

said calibration system further including a two- 
dimensional array of reference points of known loca- 
tions on the face of said screen, and means for gener- 
ating a projector-path correction table for each modular 
unit for correcting discrepancies between the known 
locations of said two-dimensional array of reference 
points on said screen and the corresponding locations 
of the two-dimensional array of reference points as 
projected on said screen. 

2. The apparatus according to claim 1, 

wherein said screen is constituted of a plurality of modu- 
lar unit screens, one provided on each of said modular 
units; 

and wherein said imaging means includes an imaging lens 
for each modular unit for imaging its respective modu- 
lar unit screen on said image sensor. 

3. The apparatus according to claim 1, wherein said 
imaging means is an imaging lens, and said screen is of a 
size and configuration to overlie all said modular units. 

4. The apparatus according to claim 1, wherein said 
two-dimensional array of reference points are defined by the 
intersection points of a plurality of horizontal reference lines 
and a plurality of vertical reference lines on said screen. 

5. The apparatus according to claim 4, wherein said 
horizontal and vertical reference lines are produced by 
luminescent material carried on a face of said screen, and a 
light source for exciting said luminescent material to cause 
it to emit light. 

6. The apparatus according to claim 5, wherein said screen 
is a light-transmissive screen and said reference lines of 
luminescent material are on the rear face of said screen, the 
front face of said screen serving as a writing surface. 

7. The apparatus according to claim 1, wherein said 
two-dimensional array of reference points are the ends of 
optical fibers on said screen. 

8. The apparatus according to claim 1, wherein said 
calibration system also generates an image path correction 
table for each modular unit for correcting discrepancies 
between the known locations of said two-dimensional array 
of reference points on said screen and the corresponding 
locations of the two-dimensional array of reference points as 
imaged on said screen. 

9. The apparatus according to claim 1, wherein said 
calibration system also utilizes said two-dimensional array 
of reference points on said screen to combine the displays 
such as to eliminate overlaps and gaps in said combined 
display. 

10. The apparatus according to claim 1, wherein said 
screen further includes a plurality of optical fibers having 
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one of their ends at a plurality of spaced locations on the 
inner face of said screen for sensing the light intensity at said 
locations; 

and wherein said apparatus further includes light detectors 
connected to the opposite ends of said optical fibers s 
producing electrical outputs corresponding to said 
sensed light intensity, and a control circuit for control- 
ling the optical projectors of said modular units to make 
uniform their light intensities. 

11. The apparatus according to claim 1, wherein: i° 
each of said projectors includes a drive having a plurality 

of degrees of movement; 
and said calibration system also corrects at least some of 
the detected distortions by controlling the drives of said s 
projectors. 

12. The apparatus according to claim 1, wherein said 
calibration system also detects and corrects color conver- 
gence distortions by: 

imaging a plurality of neighboring projected regions to 2 o 
produce an optical image of such neighboring regions 
on an image sensor, 

analyzing said optical image to estimate the color con- 
vergence distortions in the color pixels of said image; 

and digitally relocating each color pixel in said combined 25 
display a sub-pixel value to correct for said color 
convergence distortions. 

13. The apparatus according to claim 1, wherein; 

each projector includes a Fresnel lens which collimates 
the light from the respective projector; 30 

said screen being a common screen having a light- 
diffusing surface overlying all said Fresnel lenses; 

and wherein said apparatus further includes a blocking 
element underlying junctures between adjacent Fresnel 35 
lenses in order to reduce overlapping of the light from 
the projectors and thereby to produce a seamless com- 
bined display. 

14. A method of producing an electro-optical display, 
comprising: 40 

providing a plurality of modular units each including a 
projector for receiving electrical signals, converting 
them to optical images, and projecting said optical 
images via an optical projection system on a screen; 

arranging said plurality of modular units in a side -by-side 4 ^ 
array such as to combine their respective displays to 
produce a combined display; 

imaging said screen via imaging means spaced from the 
screen and producing an image of the screen on an 
image sensor on the same side of the screen as the 50 
projectors of the modular units for detecting geometri- 
cal distortions in said combined display; 

and modifying the electrical signals applied to said pro- 
jector of each modular unit to correct said combined 55 
display with respect to said detected geometrical dis- 
tortions by producing a two-dimensional array of ref- 
erence points at known locations on the face of said 
screen, and generating a projector-path correction table 
for each modular unit for correcting discrepancies tfQ 
between the known locations of said two-dimensional 
array of reference points on said screen and the corre- 
sponding locations of the two-dimensional array of 
reference points as projected on said screen. 

15. The method according to claim 14, wherein said 
two-dimensional array of reference points are produced by 



,011 Bl 

18 

the intersection points of a plurality of horizontal reference 
lines and a plurality of vertical reference lines applied to said 
screen. 

16. The method according to claim 15, wherein said 
horizontal and vertical reference lines arc produced by 
depositing luminescent material on the face of said screen, 
and exciting said luminescent material by a light source to 
cause it to emit light 

17. The method according to claim 16, wherein said 
reference lines of luminescent material are applied to the 
rear face of said screen, the front face of said screen serving 
as a writing surface. 

18. The method according to claim 14, wherein said 
two-dimensional array of reference points are produced by 
the ends of optical fibers carried by said screen. 

19. The method according to claim 14, wherein an image 
path correction table is also generated for each modular unit 
for correcting discrepancies between the known locations of 
said two-dimensional array of reference points on said 
screen and the corresponding locations of the two- 
dimensional array of reference points as imaged on said 
screen. 

20. The method according to claim 14, wherein said 
two-dimensional array of reference points on said screen are 
utilized to combine the displays of the modular units such as 
to eliminate overlaps and gaps in said combined display. 

21. The method according to claim 14, wherein the light 
intensity is sensed at each of a plurality of spaced locations 
on the inner face of said screen; and the optical projectors of 
said modular units are controlled to make uniform their light 
intensities. 

22. The method according to claim 14, wherein: 

each of said projectors includes a drive having a plurality 

of degrees of movement; 
and the drives of said projectors arc controlled to correct 

at least some of the detected distortions. 

23. The method according to claim 14, wherein color 
distortions are also corrected by detecting the intensity of 
each color component in the combined display; and modi- 
fying the electrical signals applied to said projector of each 
modular unit to correct said combined display with respect 
to said color distortions. 

24. The method according to claim 14, wherein color 
convergence distortions are corrected by: 

imaging a plurality of neighboring projected regions to 
produce an optical image of such neighboring regions 
on an image sensor; 

analyzing said optical image to estimate the color con- 
vergence distortions in the color pixels of said image; 

and digitally relocating each color pixel in said combined 
display a sub-pixel value to correct for said color 
convergence distortions. 

25. The method according to claim 14, wherein; 

each projector includes a Fresnel lens which collimates 
the light from the respective projector; 

and a common screen having a light-defusing surface 
overlying all said Fresnel lenses; 

and a blocking element is provided to underlie the junc- 
ture between adjacent Fresnel lenses in order to reduce 
overlapping of the light from the projectors and thereby 
to produce a seamless combined display. 

* ♦ * * » 
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